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CHAPTER  I 


STATEMENT  OP  THE  PROBLEM 

The  purpose  of  this  thesis  was  to  construct  and  evaluate 
a test  in  Roman  History  for  college  preparatory  students  to 
measure  achievement. 

The  test  is  divided  into  four  unequal  parts  with  a total 
of  one  hundred  and  fifty  questions  and  statements.  It  is  es- 
timated that  the  average  student  will  need  approximately 
ninety  minutes  to  complete  the  entire  test  without  undue 
hurrying  on  his  part. 

Parts  one,  two,  and  four  are  based  entirely  upon  factual 
knowledge  covered  by  the  normal  course  in  Roman  History. 

Part  three,  made  up  of  multiple  choice,  was  designed  to  give 
significance  to  the  pupil’s  ability  to  use  his  power  of 
evaluation  and  discrimination,  and  to  help  him  develop  essen- 
tial democratic  attitudes. 

William  van  Til  says1 

There  are  at  least  four  attitudes  which  are  uniquely 
democratic.  One  basic  attitude  is  respect  for  the  indi- 
vidual for  his  worth  and  dignity.  Another  democratic 
attitude  is  devotion  to  associated  effort  and  partici- 
pation by  all  in  carrying  out  cooperatively,  developed 
common  purposes  and  concerns.  Still  another  is  faith  in 


1.  William  van  Til,  "Developing  Desirable  Attitudes,"  17th 
Yearbook  of  the  National  Council  for  the  Social  Studies, 
Washington,  D.  C.,  1946,  p 65. 
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the  method  of  intelligence  in  human  affairs.  Another 
democratic  attitude  we  prize  highly  is  loyalty  to  the 
common  welfare.  Attitudes  such  as  these  are  democratic 
spearheads.  They  give  direction  and  definition  to  the 
multiple  personality  characteristics  for  which  we 
strive — openmindedness,  honesty,  fair  play,  responsi- 
bility, sincerity,  social  sensitivity,  independence, 
generosity,  dependency,  etc. 

Although  the  above  paragraph  was  written  in  connection 
with  the  teaching  of  American  history,  there  is  no  conceivable 
reason  why  the  same  attitudes  should  not  be  developed  from  a 
course  in  Roman  History,  brought  to  a conclusion  by  a well 
constructed  test. 

The  history  of  our [America^  institutions  and  law 
cannot  be  written  without  reference  to  the  history  of 
ancient  . . . Rome  . . . American  History  should  not 
forget  that  our  alphabet  and  writing,  our  basic 
religious  ideas  and  institutions,  our  literary  forms 
and  much  of  our  literary  heritage,  and  our  basic  math- 
ematics and  sciences,  our  dominant  concepts  and  tradi- 
tions in  art  and  music,  trace  back  through  many  cen- 
turies to  Europe  and  parts  of  Africa  and  Asia.l 

With  all  this  in  mind,  thought  and  time  have  been  devoted 

to  the  construction  of  a test  in  Roman  History,  a field  which 

forms  the  basis  of  many  of  our  own  American  institutions. 

Five  divisions  were  made  in  the  total  history  of  Rome: 

1.  Early  History  of  Rome  (up  to  509  E.  C.) 

2.  Expansion  of  the  Republic 

3.  Civil  Warfare 

4.  The  Western  World  Under  Roman  Rule 

5.  Decay  of  the  Roman  Empire 


1.  Erling  Li.  Hunt,  ’’Relation  of  American  History  to  the  Other 
Social  Studies,”  17th  Yearbook  of  the  national  Council  for 
the  Social  Studies,  Washington,  D.  C.,  1946,  p 174. 


. . 

. 

. 

. 

. 

. . . . . . 

~ 

- o „ . ' - 

( . c . : ; . : • 

. 

. 

. 

. - 

. 


Table  one  shows  the  distribution  of  items  over  these 


five  periods. 

TABLE  ONE 
ITEM  DISTRIBUTION 


Part 

1 

Part 

2 

Part 

3 

Part 

4 

Total 

1. 

Early  History 

21 

10 

5 

0 

36 

2. 

Expansion  of  the 
Republic 

7 

8 

3 

1 

19 

3. 

Civil  Warfare 

21 

10 

5 

3 

39 

4. 

Western  World  Under 
Roman  Rule 

5 

11 

7 

10 

33 

5. 

Decay  of  the  Empire 

6 

11 

5 

1 

23 

60 

alternate 
respons  e 

50 

chrono- 

logical 

order 

25 

multi- 

ple 

choice 

15 

match- 

ing 

150 
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CHAPTER  II 


REVIEW  OP  RESEARCH 


An  extensive  search  has  revealed  few  standard  tests  ex- 
clusively for  use  in  the  field  of  Roman  History.  Out  of  one 
hundred  ninety-nine  standard  tests  under  the  heading  Social 
Sciences  or  History,  by  Gertrude  H.  Hildreth,-*-  there  is  but 
one  such  test  listed  which  was  the  Barnard  Test  in  Roman 
History  by  A.  F.  Earnard,  from  the  School  Review,  1919.  27, 
757-771.  This  test  concerns  the  character  and  value  of 
standardized  history  tests,  and  was  of  little  help  In  the  con- 
struction or  content  of  the  problem  at  hand. 

Hildreth  listed  six  tests  in  Ancient  History  which  in- 
cluded pre-Greek,  Greek,  and  Roman  history  as  well  as  some 
medieval  history  in  a few  instances.  These  were: 

1.  Ancient  and  Medieval  History,  Comprehensive  Objective 
Tests  in  High  School  Subjects  by  L.  N.  Brown,  edited 
by  G.  C.  Wells,  Earloe  Publishing  Company,  Oklahoma 
City,  Oklahoma,  1930-34. 

2.  Cooperative  Ancient  History  Test  by  H.  R.  Anderson 
and  E.  F.  Lindquist,  Cooperative  Test  Service,  New 
York.  These  are  revised  with  the  latest  one  available 
dated  1938. 

3.  Test  on  World  History  from  Earliest  Times  through  the 
Reformation,  by  S.  Hefley.  Historical  Outlook  1929, 
20-27-29. 

4.  Sackett’s  Scale  in  Ancient  History,  by  L.  W.  Sackett, 
Journal  of  Educational  Psychology,  1917,  8,  285,  293. 


1.  Gertrude  H.  Hildreth,  A Bibliography  of  Mental  Tests  and 
Rating  Scales,  The  Psychological  Corporation,  New  York, 
1939,  ps.  165-176. 
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Ji.  Fordyce's  Test  for  History  IV  (Ancient)  "by  C. 

Fordyce,  Muskogee,  Oklahoma,  Not  available. 

£..  Institute  of  Educational  Research  Ancient  History 

Test  by  B.  D.  Wood.  For  college  entrance.  Institute 
of  Educational  Research,  Teachers  College,  1922. 

Not  available. 

The  remaining  one  hundred  ninety-three  listed,  concern 
American  history,  civics,  English  history,  etc. 

Tiegs^  in  his  listing  of  twenty-one  standard  tests  in 
Social  Sciences,  makes  no  reference  to  any  in  Roman  history. 

p 

Greene^  says 

Most  of  the  standardized  tests  which  are  now  avail- 
able for  history,  civics  and  government,  and  geography, 
were  published  some  years  ago,  so  that  it  is  largely  in 
the  form  of  a few  tests  for  general  social  studies  and 
the  social  studies  parts  of  achievement  test  batteries 
that  new  standardized  tests  have  appeared  in  this  field. 

. . . Tests  for  the  senior  high  school  are  for  American, 
ancient,  and  modern  European  history  in  the  main  . . . 

However,  Greene  does  not  quote  or  give  reference  to  any 

test  in  the  ancient  history  area,  either  in  the  text  or 

bibliography. 

Odell1 2 3 4  points  out  the  fact  that  there  are  fewer  tests  in 
the  market  in  European  and  World  History,  uyet,  their  merit  is 
much  higher, 1,4  than  those  in  American  history.  Many  more  have 
been  published,  but  are  no  longer  available.  n . . . there  is 

1.  Ernest  Tiegs,  Op.  Cit . , ps.  397-99. 

2.  Harry  A.  Greene,  Albert  N.  Jorgensen,  J.  Raymond  Gerberich, 
Op . Cit . , p 373. 

3.  C.  W.  Odell,  Educational  Measurement  in  High  School,  The 
Century  C omp a n'y , Hew  York,  1930  ps.  2G6-7 . 


4.  Ibid,  ps.  299-30C 
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none  in  ancient  history  except  as  it  is  included  in  the  more 
general  topic  of  world  history.  . . . there  are  no  standardized 
tests  dealing  with  the  history  of  any  particular  foreign 
countries . Neither  is  there  mention  of  tests  in  Roman 

history  in  Odell's  bibliography. 

o 

Gilliland  makes  no  reference  to  any  standardized  tests 
in  Roman  history.  We  know,  of  course,  the  reason  for  more 
tests  in  the  field  of  American  history  and  civics  is  because 
these  two  are  basic  studies  for  all  the  elementary  grades  as 
well  as  Junior  High  and  High  Schools,  whereas  Roman  history 
is  taught  for  half  a year  or  less,  in  a course  in  ancient 
history,  while  perhaps  two  weeks  are  the  limit  for  Roman 
history  in  a course  of  World  history. 

With  such  a dearth  of  research  background,  it  was  decided 
to  experiment  with  four  or  five  types  of  objective  questions 
or  items,  based  on  several  textbooks  in  Ancient  and  World 
history. ^ 


1.  Loc . Cit . , ps.  29S-300. 

2.  A.  R.  Gilliland,  R.  H.  Jordan,  Frank  S.  Freeman,  Educational 
Measurements  and  the  Class  Room  Teacher,  The  Century  Company, 
New  York,  1931,  ps.  222-245. 

3.  See  bibliography. 
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CHAPTER  III 


THE  TEST 

The  test,  as  shown  by  Table  1,  is  divided  into  four  un- 
equal parts  which  total  one  hundred  fifty  items  of  the  objec- 
tive type. 

Part  one,  made  up  of  sixty  questions  and  statements,  is 
of  the  alternate  response  type,  or  true  and  false  items. 
According  to  Greene,  Jorgensen,  and  Gerberich,^  true  and  false, 
involving  a choice  between  the  truth  or  falsity  of  a state- 
ment, and  the  yes-no  which  requires  one  of  these  two  answers 
to  a question,  are  the  most  commonly  used  by  teachers,  and  are 
the  most  simple  to  use,  to  take,  and  to  correct.  Pupils  like 
this  type  of  item  because  the  questions  or  statements  are 
easily  understood  and  because  it  involves  an  easy  method  of 
response,  usually  one  of  the  following: 

1.  (/)  plus  sign  for  a true  statement,  (-)  minus  for 
false . 

2.  ”T”  indicating  a true  statement,  ”F”  indicating 
false . 

5.  Encirclement  of  (T)  if  true,  of  the  (P)  if  false. 

4.  MYes"  for  true,  "No1 11  for  false. 

5.  ’’Right”  for  true  statements,  ’’Wrong”  for  wrong  items. 

1.  Harry  A.  Green,  Albert  N.  Jorgensen,  J.  Raymond  Gerberich, 

Measurement  and  Evaluation  in  the  Secondary  School, 
LongmSfts,  tireene  and  Company,  JMew  York,  1^46,  ps“TV 4-176. 
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The  time  involved  taking  a test  of  this  type  is  short, 
allowing  the  tester  to  cover  more  material  than  usual  in  a 
short  space  of  time.  Guessing  elements  are  higher  in  a true- 
false  test,  but  the  questions  are  highly  objective  and  are 
easily  and  quickly  scored. 

GENERAL  INSTRUCTIONS:  All  answers  are  to  be  recorded  on 

the  accompanying  answer  sheet  which  you  will  find  attached  to 
your  exam  questions.  You  must  be  careful  to  record  each 
answer  In  its  proper  space  on  the  answer  sheet.  Do  NOT  make 
any  marks  on  the  examination  itself.  Read  each  item  CARE- 
FULLY, answering  first,  those  questions  with  which  you  are 
most  familiar.  You  must  keep  all  papers  flat  on  your  desk  at 
ALL  times.  NO  QUESTIONS  WILL  BE  ANSWERED  BY  THE  TEACHER  IN 
CHARGE  CONCERNING  THE  EXAM  AFTER  THE  PERIOD  BEGINS. 

PART  ONE;  In  the  following  sixty  questions  or  statements, 
some  are  true,  while  others  are  false.  When  you  believe  that 
a statement  OR  ANY  PART  OF  IT  is  incorrect,  place  a minus  sign 
(-)  before  the  correct  number  on  your  answer  sheet.  If  you 
think  a statement  reads  correctly,  place  a plus  sign  (/)  in 
the  proper  space  on  your  answer  sheet. 

Sample:  1.  There  are  good  harbors  in  western  Italy. 

(/)  belongs  in  front  of  the  number  ,,lw  on 
your  answer  sheet. 

2.  The  Apennines  run  very  close  to  the  western 
shore  of  Italy. 

This  is  a false  statement;  so  you  must 
place  a minus  sign  (-)  In  front  of  number 
,,2”  on  your  answer  sheet. 
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1.  Political  unity  was  easier  to  achieve  in  Italy  than  in 
Greece . 

2.  Geography  had  little  influence  upon  the  trade  of  early 
Home . 

3.  Italy  is  divided  into  many  small  sections  because  of  its 
mountains . 

4.  The  Greeks  settled  early  in  southern  Italy. 

5.  In  the  8th  century  B.  C.,  the  Greeks  were  the  most 
backward  people  in  Italy. 

6.  Tradition  says  that  Rome  was  started  by  the  twin 
brothers,  Romulus  and  Remus. 

7.  In  the  history  of  early  Rome,  the  family  was  the  most 
important  unit. 

8.  The  Romans  worshipped  many  gods. 

9.  The  Romans  used  the  alphabet  just  as  they  received  it 
from  Greece. 

10.  When  Rome  first  began  to  “grow  upn , traders  used  gold 
and  silver  as  a medium  of  exchange. 

11.  The  Roman  upper  class  was  called  the  plebeian  class. 

12.  There  were  three  consuls  at  a time  in  Rome. 

13.  The  consuls  could  veto  the  acts  of  each  other. 

14.  The  Roman  treasurers  were  known  as  quaestors. 

15.  The  censors  decided  which  people  were  elegible  to  be  en- 
rolled as  patricians. 

16.  Any  patrician  could  become  a member  of  the  Senate. 

17.  The  Tribunes  were  officials  who  safeguarded  the  rights 
of  the  Plebeians. 

18.  Laws  had  been  written  down  before  the  “Twelve  Tables  of 
Law"  were  drawn  up. 

19.  The  Hortensian  Law  gave  the  plebeians  the  right  to 
become  consul. 
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20.  By  the  Licinian  Law,  the  plebeian  assembly  could  make 
laws  binding  on  patricians  as  well  as  plebeians. 

21.  With  the  growth  of  power  of  the  plebeians,  the  line  of 
division  between  classes  became  practically  non-existant . 

22.  About  500  B.  C.  the  Romans  conquered  the  Etruscans  and 
expelled  them  from  Roman  territory. 

23.  Along  about  the  middle  of  the  third  century  B.  C.,  Rome 
quarrelled  with  Carthage  when  the  latter  began  to  expand 
over  the  Mediterranean  world. 

24.  Hannibal  was  an  outstanding  Roman  leader  during  the  2nd 
Punic  War. 

25.  Hannibal  maintained  himself  and  his  army  in  Italy  for 
fifteen  years. 

26.  Hannibal  was  forced  to  surrender  at  Zama,  202  B.  C. 

27.  Toward  the  latter  part  of  the  second  century  B.  C. 

Roman  policy  forced  conquered  states  into  complete  sub- 
mission. 

28.  The  acquisition  of  territory  by  the  Romans  strengthened 
their  position  as  a republic. 

29.  As  the  Roman  upper  class  grew  richer,  the  poor  were 
growing  poorer. 

30.  Tiberius  Gracchus  was  a champion  of  the  rich  against  the 
poor. 

31.  Gaius  Gracchus  wanted  the  power  of  the  senate  to  be 
reduced . 

32.  The  Gracchi  brothers  were  both  killed  by  enraged  mobs. 

33.  Sulla  was  leader  of  the  Popular  Party. 

34.  Marius  killed  the  leaders  of  the  Senatorial  Party  in 
order  to  gain  power  for  himself. 

35.  Sulla  set  himself  up  as  a "perpetual  dictator." 

36.  The  word  TRIUMVIRATE  means  "three  men." 
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37.  Sulla  was  a member  of  the  first  triumvirate  in  Rome. 

38.  Other  members  of  the  triumvirate  were  Pompey  and  Crassus. 

39.  Caesar  lost  popularity  and  power  by  conquering  Gaul. 

40.  Caesar  campaigned  in  Spain  against  Pompey,  but  finally 
defeated  him  in  Greece. 

41.  A lasting  contribution  of  Caesar’s  was  his  revision  of 
the  calendar  based  on  365J  days. 

42.  Under  Caesar’s  successors,  the  Roman  Republic  gradually 
became  the  Roman  Empire. 

43.  Ey  law,  Octavian  succeeded  Caesar. 

44.  Antony  stood  by  Octavian  throughout  the  latter’s 
political  career  as  Octavian’ s right-hand  man. 

45.  Octavian  refused  to  accept  the  office  of  tribune  for 
life. 

46.  Octavian  was  chosen  consul  each  year. 

47.  Octavian  gave  little  to  charity. 

48.  We  know  Octavian  as  AU GUSTOS. 

49.  No  attempt  was  made  by  Octavian  to  stop  exploitation  of 
the  Roman  provinces. 

50.  Tiberius  inherited  the  position  of  Octavian  as 
"Imperatcr”  of  Rome. 

51.  The  reign  of  the  "Five  Good  Bnperors”  ended  with  the 
death  of  Antoninus  Pius. 

52.  Under  the  administration  of  the  Empire,  the  provincial 
governors  were  responsible  to  the  emperor  at  Rome. 

53.  Growth  of  the  Empire  had  little  to  do  with  the  develop- 
ment of  legal  practises. 

54.  Justinian's  lawyers  gathered  existing  laws  and  judicial 
decisions  into  a "Body  of  Civil  Law.” 

55.  Free  labor  and  slave  labor  worked  together  in  peace  and 
harmony  on  Roman  estates. 
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56.  Taxes  caused  no  particular  burden  on  any  one  class  in 
Rome  because  they  were  apportioned  so  fairly. 

57.  Cicero  was  the  greatest  of  the  Roman  poets. 

58.  Rome's  greatest  contribution  to  later  civilizations  was 
the  preservation  of  Greco-Oriental  culture,  which  in  some 
modification,  Rome  passed  on  to  the  West. 

59.  An  era  of  great  political  unrest  followed  the  death  of 
Marcus  Aurelius. 

60.  Hiring  of  barbarians  to  fill  the  Roman  army  greatly 
strengthened  this  body  because  of  the  great  capacity  for 
discipline  held  by  the  former. 

Anderson  and  Lindquist-*-  believe  that  it  is  impossible  for 
a student  to  have  a sufficient  understanding  of  history  in  any 
form  without  grasping  a certain  knowledge  of  both  the  chrono- 
logical and  logical  association  and  sequence  of  outstanding 
historical  events. 

It  Is  not  so  important  that  the  child  be  able  to  recall 
the  exact  date  of  an  event  or  group  of  events,  but  he  should 
be  able  to  associate  certain  happenings,  men,  etc.,  of  the 
same  relative  period. 

To  test  the  students'  grasp  of  a logical  as  well  as 
chronological  importance,  twenty-five  questions  or  items 
were  used  In  this  exam  to  replace  the  direct  recall  items 
which  were  unsatisfactory,  both  from  the  instructors'  point 
of  view  and  the  pupils l The  item  analysis  of  part  two  covers 
the  change. 

IT  Howard  R.  Anderson,  E.  F.  Lindquist,  Selected  Test  Items 
in  World  History,  Bulletin  No.  9,  National  Council  for 
the  Social  Studies,  Washington,  1947,  p 10. 
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Part  two  A was  included  because,  even  though  it  does  not 
intend  to  test  chronology,  the  application  of  correct  asso- 
ciation of  men  and  events  is  here  brought  to  the  students’ 
attention.  To  be  able  to  associate  these  correctly,  the  pupil 
must  have  some  time  sense  as  well  as  ability  to  place  men  and 
events  together  in  a logical  picture. 

PART  TWO  Directions  — The  following  twenty-five  questions, 

divided  into  five  sets  of  five  each,  are  to  be  re- 
arranged so  that  they  are  in  chronological  order, 
or  the  order  in  which  the  events  took  place.  Some 
of  the  lists  have  battles,  others  have  events,  men, 
etc.  Place  the  letters  of  the  rearranged  items  in 
their  correct  order  in  front  of  the  number  of  the 
item  on  your  answer  sheet. 

Sample:  (BCA)  A.  Roman  Empire,  (B)  Founding  of 

Rome,  (C)  Republic.  You  would  put  BCA  in 
the  proper  place  on  your  answer  sheet 
because  the  Founding  of  Rome  took  place  c. 
753  B.  C.,  the  Roman  Republic  about  500 
B.  C.,  the  Roman  Empire  began  about  31  B.  C. 

61.  (A)  Comitia  Tributa,  (B)  Comitia  Curiata,  (C)  Comitia 
Centuria ta 

62.  (A)  Battle  of  the  Metaurus  River,  (B)  Battle  of  Zama , 

(C)  Battle  of  Saguntum 

63.  (A)  Reign  of  Servius  Tullius,  (E)  Romulus,  (C) 

Tarquinius  Superbus 

64.  Battles  of  (A)  Caudine  Forks,  (B)  Sentinum,  (C)  Keraclea 
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65.  (A)  Conquest  of  Cis-Alpine  Gaul,  (B)  Reduction  of 
Corsica,  (C)  Sicily  becomes  the  first  Roman  province 

66.  Battles  of  (A)  Lake  Trasumenus,  (B)  Ticinus,  (C)  Cannae 

67.  (A)  Social  War,  (B)  War  against  Cimbri  and  Teutones, 

(C)  War  against  Jugurtha 

68.  (A)  Death  of  Marius,  (B)  Sulla  occupies  Rome,  (C)  Marian 
Massacres 

69.  (A)  Sulla’s  dictatorship,  (B)  Sulla  vs.  the  Marian  party, 
(C)  Sullan  Proscriptions 

70.  (A)  Pompey  represses  revolt  of  Lepidus,  (B)  Pompey 
destroys  the  pirates,  (C)  Pompey  defeats  Sertorius  in 
Spain 

71.  (A)  Caesar  invades  Gaul,  (B)  Caesar  becomes  consul, 

(C)  Caesar  invades  Britain 

72.  (A)  Assassination  of  Caesar,  (B)  death  of  Cicero,  (C) 
death  of  Octavian 

75.  (A)  Battle  of  Philippi,  (B)  Title  of  ’'Augustus'*  conferred 

upon  Octavian,  (C)  Battle  of  Actium 

74.  (A)  Reign  of  'Tiberius,  ( B ) Birth  of  Christ,  (C)  Battle 
of  Teutoberg  Forest 

75.  (A)  Reign  of  Caligula,  (B)  Reign  of  Claudius,  (C)  Reign 
of  Nero 

76.  (A)  Pompeii  destroyed,  (B)  Destruction  of  Jerusalem, 

(C)  Crucifixion  of  Christ 

77.  Reigns  of  (A)  Hadrian,  (B)  Marcus  Aurleius,  (C)  Commodus 

78.  Rule  of  (A)  Soldier  emperors,  (B)  Antonine  emperors, 

(C)  Flavian  emperors 

79.  (A)  General  persecution  of  Christians,  (B)  First  invasion 
of  Gauls,  (C)  Rise  of  new  Persian  monarchy 

80.  (A)  Council  of  Nicea,  (B)  Edict  of  Milan,  (C)  Founding 
of  Constantinople 
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81.  (A)  Battle  of  Adrianople,  (B)  Final  division  of  the 
Empire,  (C)  Visigoths  cross  the  Danube 

82.  (A)  Battle  of  Chalons,  (B)  Alaric  sacks  Rome,  (C) 
Genseric  invades  Rome 

85.  Peopling  of  (A)  Greece,  (B)  southern  Italy,  (C)  northern 
Italy 

84.  (A)  Hannibal’s  defeat,  (B)  Hannibal  invades  Italy,  (C) 
Hannibal  crosses  the  Alps 

85.  (A)  Roman  victory  at  Aegates  Islands,  (B)  Publius 
Claudius  defeated  near  Sicily,  (C)  Regulus  invades 
Africa 


PART  TWO  A Directions — In  each  of  the  following  groups, 

indicate  by  placing  the  letters  of  the  selected 
names,  the  TWO  NAMES  which  are  very  closely 
associated,  before  the  proper  number  on  your 
answer  sheet. 

Sample:  AC  (A)  Servius  Tullius,  (B)  Janus, 

(C)  Tarquinius  Superbus.  The  letters  AC 
should  be  selected  because  both  Servius 
Tullius  and  Tarquinius  Superbus  were 
Etruscan  kings  of  Rome.  Janus  was  a god. 


86.  (A)  Jupiter,  (B)  Vesta,  (C)  Mercury 

87.  (A)  Mercury,  (B)  Ceres,  (C)  Vesta 

88.  (A)  jus  connubium,  (B)  jus  commercium,  (C)  jus  suffragium 

89.  (A)  Consuls,  (B)  Tribunes,  (C)  Quaestors 

90.  (A)  Caesar,  ( E ) Hadrian,  (C)  Cicero 

91.  (A)  Nerva,  (B)  Nero,  (C)  Trajan 

92.  (A)  Pompey,  (E)  Crassus,  (C)  Octavian 

93.  (A)  Scipio  Africanus,  (B)  Hamilcar  Barca,  (C)  Hannibal 
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94. 

(A) 

95. 

(A) 

96. 

(A) 

97. 

(A) 

98. 

(A) 

99  . 

(A) 

100. 

(A) 

101. 

(A) 

102. 

(A) 

103. 

(A) 

104. 

(A) 

105. 

(A) 

106. 

(A) 

107. 

(A) 

108. 

(A) 

109. 

(A) 

110. 

(A) 

Cannae,  (B)  Zama , (C)  Metaurus  River 

Sicily,  (B)  Hibernia,  (C)  Sardinia 

Pompeii,  (3)  Herculaneum,  (C)  Jerusalem 

Rubicon,  (B)  Tiber,  (C)  Arnus 

Adriatic,  (B)  Aegean,  (C)  Tyrrhenian 

Marius,  ( B ) Cinna,  (C)  Sulla 

Caesar,  (B)  Cicero,  (C)  Cato 

Horace,  (£)  Virgil,  (C)  Justinian 

Teutoberg  Forest,  (B)  Actium,  (C)  Philippi 

Caesar,  (E)  Lucretius,  (C)  Sallust 

Cattulus,  (B)  Lucretius,  (C)  Cicero 

Arminius,  (B)  Agrippa , (C)  Maecenas 

’’Art  of  Love,”  (B)  ’’Eclogues,”  (C)  ’’Aeneid” 

Vespasian,  (B)  Titus,  (C)  Nero 

Seneca,  (B)  Tacitus,  (C)  Marcus  Aurelius 

Colosseum,  (E)  Hadrian’s  Tomb,  (C)  Claudian  Aqueduct 

Constantine,  (B)  Nero,  (C)  Domitian 


To  quote  Greene,  Jorgensen,  and  Gerberich,1  ”Kultiple 
choice  is  usually  made  up  of  an  incomplete  statement,  followed 
by  from  three  to  five  responses  which  will  complete  the  state- 
ment.” The  student  is  expected  to  select  from  these  possible 
answers,  the  one  which  makes  the  statement  read  correctly. 


1.  Harry  A.  Greene,  Albert  N.  Jorgensen,  J.  Raymond  Gerberich, 
Op.  Clt.,  p 177 
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Sometimes  a negative  multiple  choice  statement  is  used.  Here, 
instead  of  selecting  the  correct  answer,  the  student  is  ex- 
- pected  to  indicate  the  WRONG  answer.  These  two  types  should 
never  he  used  in  the  same  part  of  the  examination  because 
doing  so  has  a tendency  to  confuse  the  child. 

Anderson  and  Lindquist  say1 

The  multiple  choice  is  perhaps  the  most  valuable  for 
social  studies  testing.  It  may  be  used  in  an  attempt  to 
measure  such  things  as  appreciation  and  understanding  of 
cause  and  effect  relationships,  factors  underlying  im- 
portant developments,  consequences  of  certain  actions, 
and  the  significance  of  certain  political,  social,  and 
economic  situations  and  practises. 

There  are  several  mistakes  to  avoid  in  the  construction 
of  multiple  choice  questions,  however.  Among  these,  four  are 
outstanding. ^ 

1.  Make  sure  that  the  correct  response  cannot  be 
selected  on  the  basis  of  grammatical  consistency. 

2.  Make  sure  that  the  correct  response  cannot  be 
selected  on  the  basis  of  identical  phrasing  in  the 
introductory  statement. 

3.  Make  sure  that  the  correct  response  cannot  be 
determined  on  the  basis  of  a lack  of  homogeneity  in 
the  list  of  responses. 

4.  Make  sure  that  the  correct  response  cannot  be  iden- 
tified by  stereotyped  phrases  or  textbook  language 
which  the  pupil  may  have  learned  by  rote. 


1.  Howard  R.  Anderson,  E.  F.  Lindquist,  Selected  Test  Items 
in  World  History,  Op.  Cit . , p 12. 

2.  Emerson  C.  Denny,  An  Investigation  of  the  Defects  and 
Weaknesses  in  Certain  Objective  Test  Items  in  American 
History , Unpublished  Doctorate,  State  University  of  Io'wa, 
1932,  ps.  37-50. 
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Greene,  Jorgensen,  and  Gerberich1  have  several  good 
suggestions  for  the  construction  of  multiple  choice  items. 

1 . As  much  of  the  statement  as  possible  should  occur  in 
the  introductory  portion.  There  is  no  justification 
for  the  repetition  of  the  same  introductory  word  or 
words  in  each  of  the  alternatives.  • . . 

2.  Alternative  answers  should  all  be  stated  in  correct 
grammatical  style . It  should  be  possible  to  follow 
the  introductory  portion  of  an  item  with  any  one  of 
the  alternative  answers  and  have  the  statement 
grammatically  correct. 

3.  Incorrect  alternatives , or  - confusions , should  be 
plausible.  One  or  more  alternatives  which  are 
obviously  incorrect  . . . give  the  pupil  a greater 
chance  of  guessing  the  correct  answer.  . . . 

4.  nAu  or  “an11  should  ordinarily  not  be  used  to  intro- 
duce the  alternative  answers . Unless  all  answers 
could  follow  the  same  article  with  grammatical 
correctness,  the  a(n)  device  . . . should  be  used.  . . 

5.  Items  should  ordinarily  have  four  or  five  alternate 
answers . . . . four  or  five  alternative  answers  are 
preferable  as  a means  of  reducing  the  chance  of 
guessing  . . . and  in  order  to  obtain  the  desired 
degree  of  item  difficulty  . . . 

6.  All  items  should  ordinarily  have  the  same  number  of 
alternate  answers . Four  and  five-response  items  may 
be  mixed  in  the  same  test  although  the  same  number  of 
alternatives  for  each  item  is  preferable  for  ease  in 
correction  of  guessing. 

Even  though  multiple-choice,  or  best  answer  item,  is 
probably  the  most  widely  used  objective  type  question  in 
social  studies  testing,  it  is  not  an  economical  form  of 
testing  for  command  of  factual  knowledge,  and  good  items 
require  great  care  in  their  construction. 


1.  Harry  A.  Greene,  Albert  N.  Jorgensen,  J.  Raymond  Gerber ich. 

Op.,  cl  t . p 193. 
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"The  multiple  choice  is  especially  useful  for  the 
evaluating  understanding  of  concepts  and  terminology  used  in 
the  study  of  history  and  other  social  studies. 


PART  THREE  Dlrections--In  the  following  twenty-five  questions 
or  statements,  read  each  one  very  carefully. 

Next,  look  at  the  five  possible  answers  listed 
below  as  a,  b,  c,  d,  and  e.  Select  the  answer 
which  you  believe  is  the  best  solution  to  the 
question  or  statement,  and  write  the  LETTER  of 
that  answer  after  the  proper  number  of  the  question 
on  your  answer  sheet. 

Sample:  1.  (c)  Which  of  the  following  would  be 

the  most  important  factor  in  agriculture 
of  Italy? 

a.  many  mountain  ranges 

b.  little  rainfall 

c.  fertile  soil 

d.  swift  rivers 

e.  good  harbors 


111.  The  most  Important  mountains  in  Italy  are  the 

a.  Alps 

b.  Caucausus 

c.  Pyrennees 

d.  Apennines 

e.  Pindus 

112.  The  people  from  whom  the  Romans  learned  most  about 
government  were  the 

a.  Latins 

b.  Etruscans 

c.  Samnites 

d.  Greeks 

e.  Carthaginians 


1.  Horace-  T.  Morse  and  George  II.  McCune,  ’’Evaluation  of  Under- 
standing,” Seventeenth  Yearbook  of  the  National  Council  for 
the  Social  Studies,  Washington,  1946,  p 361. 
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113. 


The  people  who  added  the  capital  letters  to  the  alphabet 
were  the 

a.  Greeks 

b.  Phoenicians 

c.  Chinese 

d.  English 

e . Romans 

114.  The  early  Roman  government  was  controlled  by  the 

a.  patricians 

b.  plebeians 

c.  consuls 

d.  dictator 

e.  army 

115.  Among  the  lesser  Roman  officials  were  the 

a.  consuls 

b.  dictator 

c.  senators 

d.  quaestors 

e . kings 

116.  An  outstanding  leader  of  the  Romans  during  the  2nd 
Punic  War  was 

a.  Hamilcar  Barca 

b.  Scipio  Africanus 

c.  Hannibal 

d.  Kasdrubal 

e.  Caesar 

117.  After  the  Punic  Wars,  Rome  regarded  its  conquered 
states  as 

a.  completely  independent  except  for  a Roman 
governor 

b.  politically  dependent  on,  but  commercially  inde- 
pendent 

c.  completely  submissive  to  Rome 

d.  dependent  on  Rome  for  five  years,  then  regarded 
as  ’’allies’'  of  Rome  with  complete  freedom 

e.  independent  on  payment  of  ^10,000  annual  tribute 
to  Rome  for  a period  of  twenty-five  years 

113.  During  the  two  centuries  before  Caesar,  changes  in  Rome 
that  were  particularly  noticeable  were 

a.  worship  of  material  power  and  possessions 

b.  decline  of  idleness 

c.  lack  of  self-ambition 

d.  release  of  forces  supporting  the  republican 
form  of  government 

e.  utter  disappearance  of  the  leisure  class 
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119.  Among  the  problems  confronting  the  Romans  in  the  second 
and  third  centuries  B.  C.  were  (was) 

a.  revolts  on  the  provinces 

b.  commercial  rights  of  the  provinces 

c.  discontent  among  the  lower  classes 

d.  growing  strength  of  the  slaves 

e.  barbarians  threatening  to  break  through  the 
frontiers 

120.  The  members  of  the  First  Triumvirate  were 

a.  Pompey,  Crassus,  Mark  Antony 

b.  Crassus,  Mark  Antony,  Caesar 

c.  Mark  Antony,  Caesar,  Octavian 

d.  Caesar,  Octavian,  Pompey 

e.  Caesar,  Pompey,  Crassus 

121.  To  oppose  Caesar’s  growing  power,  the  Senate  appointed 

a.  Mark  Antony 

b.  Pompey 

c.  Sulla 

d.  Octavian 

e.  Marius 

122.  Wh en  Caesar  was  murdered,  he  was  in  the  midst  of  plans 
to  extend  Roman  power  to 

a.  Britain 

b.  Gaul 

c.  Sicily 

d.  Persia 

e.  Egypt 

123.  Octavian  kept  his  popularity  among  his  people  by 

a.  assuming  title  of  emperor 

b.  immediately  releasing  all  political  prisoners 

c.  personal  expenditures  for  public  works  and 
aiding  the  poor 

d.  building  a pretentious  palace 

e.  "buying”  his  political  enemies 

124.  Among  the  public  works  of  Octavian  were  (was) 

a.  some  buildings  to  house  the  poor 

b.  entertainments  of  foreign  celebrities 

c.  establishment  of  a praetorian  guard 

d.  public  races  by  famous  charioteers 

e.  the  Pantheon  which  w as  later  rebuilt  by  Hadrian 
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125. 


During  the  period  of  the  Roman  Qnpire,  the  successor  to 
each  emperor  was 

a.  chosen  by  the  people  in  public  election 

b.  usually  '’adopted”  by  the  emperor  before  his 
death 

c . chosen  by  lot 

d.  appointed  by  the  Senate 

e.  appointed  by  the  Assembly 

126.  The  "Five  Good  Emperors"  were 

a.  Octavian,  Tiberius,  Claudius,  Nero,  Vespasian 

b.  Octavian,  Nero,  Vespasian,  Titus,  Domitian 

c.  Nerva , Trajan,  Hadrian,  Antoninus  Pius,  Marcus 
Aurelius 

d.  Trajan,  Hadrian,  Antoninus  Pius,  Marcus 
Aurelius,  Commodus 

e.  Marcus  Aurelius,  Commodus,  Constantine, 
Diocletian,  Arcadius 

127.  Which  one  of  the  following  groups  did  NOT  pay  taxes 
to  Rome? 

a.  Germans  east  of  the  Rhine 

b.  people  of  Sicily 

c.  Gauls 

d.  Egyptians 

e.  Syrians 

128.  All  provincial  governors  were  responsible  to 

a.  themselves  only 

b.  military  leader  of  their  respective  provinces 

c.  Roman  senate 

d.  the  Provincial  Assembly 

e.  emperor  at  Rome 

129.  Those  taking  part  in  the  administration  of  the  Roman 
government  were  trained  officials  from  the 

a.  city  of  Rome 

b.  provinces  as  well  as  Italy 

c.  Italy  only 

d.  provinces 

e.  army 

150.  Education  was  reserved  for 

a.  upper  class  only 

b.  middle  class  only 

c.  slaves 

d.  boys  from  any  class  who  wished  to  become 
politicians 

e.  upper  and  middle  class 
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131.  Roman  culture  was  stimulated 

a.  growth  of  a wealthy  leisure  class 

b.  many  slaves  who  were  learned  men 

c.  literary  competitions  in  which  prizes  were 
offered 

d.  Greek  philosophers 

e.  natural  ability  of  the  Romans  in  art  and 
literature 

132.  Following  the  death  of  Marcus  Aurelius  there  occurred 

a.  a period  of  great  peace 

b.  rule  by  foreign  demagogues 

c.  an  invasion  by  the  Teutons 

d.  a period  of  political  chaos 

e.  control  of  Rome  by  the  slaves 

133.  Economically,  Rome  suffered  in  the  last  years  of  the 
Empire  because 

a.  barbarians  gained  control  of  all  the  good 
harbors 

b.  use  of  a greater  number  of  slaves  proved  to  be 
too  much  for  free  labor 

c.  heavy  taxes  because  of  lavish  expenditures  for 
army  and  government  officials 

d.  provinces  refused  to  pay  taxes  to  Rome 

e.  new  methods  of  agriculture  threw  many  men  out 
of  work 

134.  The  downfall  of  Rome  was  a gradual  process  of  decay 
because  of 

a.  a great  exodus  from  the  empire  of  its  people  to 
other  countries 

b.  a compromise  between  Rome  and  the  teutonic 
barbarians 

c.  new  methods  of  warfare  used  by  the  barbarians 

d.  political  weakness  and  corrupt  Roman  officials 

e.  Romans  no  longer  cared  about  keeping  up  the 
prestige  of  the  Empire  known  during  the  time  of 
Caesar  and  Octavian 

135.  The  character  of  the  Roman  army  changed  during  the 
latter  part  of  the  Einpire  because 

a.  the  government  was  forced  to  hire  barbarians  to 
fill  out  the  army  complement 

b.  physically,  Romans  were  no  longer  able  to  fight 
well 

c.  upper  class  Romans  no  longer  served  in  the  army 

d.  military  leaders  were  political  appointees  with 
little  training 

e.  term  of  soldiers  was  cut  to  six  months 
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Part  four  was  originally  made  up  of  one  group  of  fifteen 
matching  questions.  The  revised  test  will  utilize  the  same 
questions,  but  will  have  them  broken  down  into  smaller  groups 
of  possibly  three  items  in  the  left  column  with  a choice  of 
four  or  five  responses  in  the  right  hand  column.  As  the  test 
rests  now,  the  right  hand  column  may  be  used  for  any  of  the 
groups  in  the  left  hand  column. 

Matching  questions  really  are  a form  of  multiple  choice 
exercises  set  up  in  a little  different  style.  The  usual 
matching  test  is  set  up  with  two  columns  with  the  expectation 
that  the  pupil  will  select  a phrase  or  group  of  words  from 
one  column- -usually  the  matching  is  done  from  right  to  left-- 
and  indicate  his  selection  by  placing  the  number  or  letter  of 
that  phrase  in  front  of  the  item  in  the  left  hand  column  with 
which  the  student  connects  it.  If  an  answer  sheet  is  used, 
the  letter  or  number  will  be  written  on  the  ansv;er  sheet  after 
or  before  the  number  of  the  item  on  the  examination. 

Greene,  Jorgensen,  and  Gerberich  have  this  to  say  about 
matching  exercises.1 

Matching  exercises  are  likely  to  be  rather  highly 
factual  in  nature,  and  to  make  use  of  the  who,  wha t , when, 
and  where  types  of  relationships  and  of  identifying  or 
naming  abilities.  They  are  rather  easy  to  construct,  and 
are  perhaps  for  that  reason  more  widely  used  than  their 
characteristics  warrant.  They  are  likely  to  Include 
clues  to  the  correct  responses  unless  there  is  rigid 

1.  Harry  A.  Greene , Albert  Jorgensen,  J.  Raymond  Gerberich, 

Op.  cl  t . . p.  183. 
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adherence  to  uniform  categories  of  items  in  a matching 
set,  and  this  restriction,  desirable.as  it  is,  limits  at 
least  one  side  of  the  test  unit  to  numbers,  words,  or  at 
least,  short  phrases. 

Sometimes  it  is  very  difficult  to  construct  a satisfactory 
matching  type  set  of  questions  on  a short  unit,  but  whereas 
this  thesis  is  based  upon  the  building  and  evaluation  of  a 
unit  covering  approximately  seven  centuries  of  Roman  history, 
it  was  deemed  wise  to  insert  several  matching  type  items, 
host  pupils  are  familiar  with  this  particular  testing  device 
and  are  acquainted  with  the  method  of  response.  Three  or 
four  different  types  of  questions  in  an  exam  certainly  help 
to  relieve  the  monotony  for  the  student  and  would  seem  to 
have  a good  psychological  effect  upon  his  attitude  toward  the 
examination. 

Morse  and  McCune^  declare  that 

The  matching  form  is  also  especially  useful  for 
testing  an  understanding  of  chronological  relationships. 

A list  of  dates  in  one  column  and  events  in  another, 
while  easiest  to  construct,  does  not  measure  the 
relational  aspect  of  time  sequence,  which  is  more  im- 
portant in  understanding  history. 


1.  Horace  T.  Morse  and  George  K.  McCune,  ’'Evaluation  of 
Understanding,"  Op.  C i t . . , p 364 


. 
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PART  FOUR  Direct lons--In  the  following  five  groups  of  three 


items  each,  you  are  to  select  a word  from  the  right 
hand  column  which  best  describes  each  item  in  the 
left  hand  column.  Be  sure  that  you  place  the 
letter  of  the  item  you  choose  from  the  right  hand 
column  in  front  of  the  proper  number  on  your 
answer  sheet.  Items  from  the  list  of  professions 
in  column  MBM  may  be  used  as  many  times  as  you 
think  necessary. 


Sample:  A 

b Agrip'pa 
e Nero 
a ^Cleopatra 


B 

a.  queen 

b.  military  leader 

c.  scientist 

d.  orator 

e.  emperor 


-;h;-  whj-  -if-;:-# 


A 

B 

136. 

Hannibal 

a . 

military  leader 

137. 

Caesar 

138. 

Cicero 

b. 

poet 

139. 

Justinian 

c . 

philosopher 

140. 

Livy 

141. 

Horace 

d. 

orator 

142. 

Virgil 

e • 

medical  authority 

143. 

Seneca 

144. 

Tacitus 

f . 

biographer 

145. 

Galen 

g- 

histor  ian 

146. 

Plutarch 

147. 

Tiberius  Gracchus 

h. 

authority  on  law 

148. 

Odoacer 

i. 

geographer 

149. 

Ptolemy 

150. 

Marius 

J« 

reformer 

.r 

. 

. 


. 

. 
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CHAPTER  IV 


ANALYSIS  OF  TEST  DATA 


The  basic  function  of  all  measurement  is  to 
place  individuals  along  a scale  of  ability  or  achieve- 
ment in  approximate  accordance  with  their  real  differ- 
ences in  ability  or  achievement.  Such  a function  im- 
plies discriminative  power  on  the  part  of  the  test. 

Since  tests  are  made  up  of  separate  items,  it  is  clear 
that  each  item  comprising  a test  must  have  this 
quality  in  a maximum  degree  if  the  total  test  is  to 
oossess  it.  Discriminative  power  in  a test  or  a test 
Item  means  that  a different  quality  or  magnitude  of 
response  may  be  expected  from  individuals  or  groups 
possessing  the  abilities  in  question  in  varying 
degrees.  Pupils  with  limited  ability  should  fail  the 
item  more  often  than  should  superior  pupils.  ^ 

Item  analysis  or  item  count  was  taken  for  each  of  the  one 

hundred  and  fifty  items  for  the  purpose  of  determining  which  of 

the  questions  or  statements  to  retain  or  to  reject  as  having 

little  testing  value. 

According  to  Mills, ^ the  critical  ratio  (c.r.)  necessary 
to  retain  an  item  in  an  examination  is  2.576.  An  item  showing 
a critical  ratio  below  this  figure  should  either  be  eliminated 
entirely  or  revised,  because  as  it  stands,  it  lacks  the  power 
to  discriminate  between  the  good  student  and  the  poor  student. 
In  other  words,  the  item  is  either  too  easy,  or  too  hard  for 
both  kinds  of  pupils.  However,  it  seems  a good  policy  to  re- 
tain a few  simple  items  in  order  to  give  encouragement  to  the 


1.  Harry  A.  Greene,  Albert  N.  Jorgensen,  J.  Raymond  Gerber ich. 
Op . Cl t . , p 80. 

2.  Frederick  C.  Mills,  Statistical  Methods,  (revised),  Henry 
Holt  and  Company,  New  York,  1938,  p 471. 
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student  who,  as  he  glances  over  the  exam,  sees  at  first,  few 
items  which  he  is  able  to  answer  with  any  degree  of  confidence. 

If,  however,  the  critical  ratio  is  above  2.576,  the  item 
is  doing  the  job  it  is  supposed  to  do — discriminate  between 
the  superior  and  the  inferior  student--and  should  be  retained. 

A total  of  thirty-three  items  or  22$  of  the  one  hundred 
and  fifty  items  scattered  throughout  the  four  divisions  of  the 
examination  were  found  to  be  below  Mills*  critical  ratio  of 
2.576.  This  was  higher  by  far  than  what  was  anticipated  when 


the  test  was  administered 


. 

. 

; L 


=# 


TABLE  TWO 

ITEM  ANALYSIS  PART  I 


ITEM 

UPPER  QUARTER 

LOWER  QUARTER 

PER  CENT 

STAN- 

CRITI- 

OP 

OP 

DIFFER- 

DARD 

CAL 

CORRECT  ANSWERS 

CORRECT  ANSWERS 

ENCE 

ERROR 

RATIO 

1 

• 66 

.26 

.40 

.091 

4. 39*7 

2 

.28 

.04 

.24 

.064 

3.750 

3 

.90 

.58 

.32 

.082 

3.902 

4 

.86 

.34 

.52 

.083 

6.265 

5 

.86 

.42 

.44 

.086 

5.116 

6 

.58 

.06 

.52 

.078 

6.667 

7 

.46 

.18 

.28 

.089 

3.146 

8 

.98 

.60 

.38 

.072 

5.227 

9 

.52 

.24 

.28 

.093 

3.011 

10 

.26 

.10 

.16 

.075 

2.133 

11 

.36 

.08 

.28 

.073 

3.589 

12 

.36 

.02 

.34 

.071 

4.788 

13 

.66 

.14 

.52 

.083 

6.265 

14 

.30 

.10 

.20 

.077 

2.596 

15 

• 66 

.48 

.18 

.098 

1.836 

16 

.90 

.24 

.66 

.073 

9.041 

17 

.28 

.06 

.22 

.072 

3.055 

18 

.96 

.70 

.26 

.071 

3.662 

19 

.96 

.46 

.50  • 

.075 

6.667 

20 

.36 

.12 

.24 

.082 

2.926 

21 

.86 

.64 

.22 

.084 

2.619 

22 

.54 

.06 

.48 

.079 

6.025 

23 

.34 

.16 

.18 

.085 

2.117 

24 

.68 

.11 

.57 

.079 

7.215 

25 

.78 

.54 

.24 

.092 

2.608 

26 

.46 

.18 

.28 

.089 

4.146 

27 

.48 

.00 

.48 

.071 

6.761 

28 

.12 

.06 

.06 

.058 

1.034 

29 

.04 

.00 

.04 

.028 

1.429 

30 

.30 

.10 

.20 

.077 

2.596 

31 

• 66 

.14 

.52 

.083 

6.265 

32 

.00 

.00 

.00 

.000 

0.000 

33 

.28 

.06 

.22 

.072 

3.055 

34 

.92 

.56 

.36 

.080 

4.500 

35 

.84 

.30 

.54 

.083 

6.506 

36 

.36 

.12 

.24 

.082 

2.926 

37 

.52 

.34 

.18 

.098 

1.836 

38 

.88 

.30 

.58 

.080 

7.250 

39 

.70 

.42 

.28 

.096 

2.916 

40 

.94 

.52 

.42 

.079 

5.316 

41 

.32 

.04 

.28 

.072 

3.889 

42 

.88 

.40 

.48 

.083 

5.783 

43 

.26 

.10 

.16 

.075 

2.173 

TABLE  TWO  (CONTINUED) 
ITEM  ANALYSIS  PART  I 


ITEM 

UPPER  QUARTER 

LOWER  QUARTER 

PER  CENT 

STAN- 

CRIT- 

OF 

OF 

DIFFER- 

DARD 

I CAL 

CORRECT  ANSWERS 

CORRECT  ANSWERS 

ENCE 

ERROR 

RATIO 

44 

.36 

.08 

.28 

.078 

3.589 

45 

.86 

.54 

.32 

.086 

3.721 

46 

.98 

.48 

.50 

.074 

6.757 

47 

• 66 

.26 

.40 

.091 

4.397 

48 

.76 

.24 

.52 

.035 

6.117 

49 

.52 

.34 

.18 

.098 

1.836 

50 

1.00 

.86 

.14 

.051 

2.745 

51 

.74 

.20 

.54 

.084 

6.428 

52 

.30 

.10 

.20 

. 077 

2.596 

53 

.18 

.04 

.14 

.061 

2.295 

54 

.12 

.06 

.06 

.058 

1.234 

55 

.94 

.30 

.64 

.073 

8.765 

56 

.70 

.42 

.28 

.096 

2.915 

57 

.78 

.54 

.24 

.092 

2.608 

58 

.64 

.08 

.52 

.079 

6.582 

59 

.96 

.52 

.44 

.076 

5.789 

60 

.96 

.58 

.38 

.075 

5.066 

In  the  above  table  which  is  an  item  count  of  Part  One 
made  up  of  sixty  T-F  items,  the  following  items  are  below 
the  critical  ratio  of  2.576:  10,  15,  28,  29,  52,  27,  43, 

49,  53,  and  54.  These  ten  items  will  be  revised  and  sub- 
jected to  another  item  count  before  the  final  revision  of 
the  examination.  They  will  be  reworded  so  as  to  make  the 
answer  less  obvious  or  will  be  eliminated  entirely.  In  a 
casual  word  check  among  available  students  who  took  the  pre- 
liminary test,  the  general  opinion  was  that  these  Items  were 
much  too  easy. 
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TAELE  THREE 


ITEM  ANALYSIS  PART  II 


ITEM  UPPER  QUARTER 
CF 

CORRECT  ANSWERS 

LOWER  QUARTER 
OF 

CORRECT  ANSWERS 

PER  CENT 
DIFFER- 
ENCE 

STAN- 

DARD 

ERROR 

CRIT- 

ICAL 

RATIO 

61 

.52 

.34 

.18 

.098 

1.836 

62 

.36 

.12 

.24 

.082 

2.926 

65 

.60 

.34 

.26 

.096 

2.708 

64 

.40 

.38 

.02 

.098 

0.204 

65 

.22 

.04 

.18 

.065 

2.769 

66 

.22 

.00 

.22 

.059 

3.729 

67 

.32 

.04 

.28 

.072 

3 • 889 

68 

.70 

.42 

.28 

.096 

2.916 

69 

.15 

.02 

.13 

.056 

2.500 

70 

.22 

.08 

.14 

.070 

2.000 

71 

.12 

.06 

.06 

.058 

1.034 

72 

.18 

.04 

.14 

.061 

2.295 

73 

.26 

.10 

.16 

.075 

2.133 

74 

.52 

.24 

.28 

.093 

5.011 

75 

.72 

.02 

.70 

.066 

10.606 

76 

.50 

.02 

.48 

.074 

6.486 

77 

.26 

.10 

.16 

.075 

2.133 

78 

.74 

.38 

.34 

.093 

3.656 

79 

.52 

.06 

.46 

.079 

5.822 

80 

.90 

.42 

.48 

.082 

5.853 

81 

.46 

.18 

.28 

.089 

3.146 

82 

.84 

.26 

.58 

.087 

7.160 

83 

.00 

.00 

.00 

.000 

0.000 

84 

.30 

.10 

.20 

.077 

2.596 

85 

.12 

.06 

.06 

.058 

1.034 

86 

.26 

.10 

.16 

.075 

2.133 

87 

.60 

.22 

.38 

.091 

4.175 

88 

.80 

.38 

.42 

.090 

4.667 

89 

.32 

.04 

.28 

.072 

3.889 

90 

.74 

.38 

.34 

.093 

3.656 

91 

.68 

.11 

.57 

.079 

7.215 

92 

.28 

.04 

.24 

.064 

3.750 

93 

.64 

.08 

.56 

.078 

7.179 

94 

.50 

.02 

.48 

.074 

6.486 

95 

.52 

.36 

.16 

.098 

1.632 

TABLE  THREE  ( CONTINUED) 
ITEM  ANALYSIS  PART  II 


ITEM 

UPPER  QUARTER 

LOWER  QUARTER 

PER  CENT 

STAN- 

CRIT- 

OP 

OF 

DIPPER- 

BARD 

I CAL 

CORRECT  ANSWERS 

CORRECT  ANSWERS 

ENCE 

ERROR 

RATIO 

96 

.78 

.54 

.24 

.092 

2.608 

97 

.52 

.46 

.06 

.099 

0.606 

98 

.28 

.04 

.24 

.064 

3.750 

99 

.52 

.36 

.16 

.098 

1.632 

100 

.18 

.04 

.14 

.061 

2.295 

101 

.22 

.12 

.10 

.075 

1.333 

102 

.08 

.06 

.02 

.051 

0.392 

103 

.86 

.42 

.44 

.086 

5.116 

104 

.36 

.02 

.34 

.071 

4.788 

105 

.30 

.10 

.20 

.077 

2.596 

106 

.66 

.26 

.40 

.091 

4.397 

107 

.90 

.64 

.26 

.080 

3.250 

108 

.80 

.30 

.50 

.087 

5.747 

109 

.80 

.18 

.62 

.079 

7.848 

no 

.90 

.42 

.48 

.082 

5.853 

Seventeen 

items 

in  Part  Two,  wher 

e chronology 

and  associa' 

tion 

items  were 

substituted  for  the  original  one  word  comple- 

tlon 

sentences , 

have 

a critical  ratio 

below  2.576. 

No  attempt 

was  made  to  reword  the 

completion 

items 

of  the 

original  test  or  to  revise  them  in  any  way  so  as  to  include 
them  in  the  revised  test. 

Completion  type  items  would  seem  to  have  little 
value  for  measuring  understanding  in  history.  The  form 
lends  itself  well  to  testing  for  the  recall  of  facts, 
such  as  names,  dates,  places,  etc.,  unless  the  response 
required  is  of  such  length  that  the  question  takes  on 
more  of  the  nature  of  a subjective  than  an  objective 
item. 


1.  Horace  T.  Morse  and  George  K.  KcCune,  "Evaluation  of 
Understanding, " Op.  Clt . , p 364. 
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The  simple  recall  item  is  not  easy  to  score  be- 
cause of  the  tendency  for  the  responses  to  lack  com- 
plete objectivity  even  though  responses  may  be  pro- 
vided for  in  terminal  and  aligned  form  ...  it  is 
not  directly  adaptable  to  machine  . . . scoring. ^ 

This  type  of  question  is  probably  the  most 
difficult  of  the  objective  type  of  questions  to  answer 
and  also  to  construct.  This  is  particularly  true  of 
those  involving  reasoning.  . . . There  is  further 
difficulty  on  scoring;  namely,  that  it  is  often  possi- 
ble to  have  several  answers  for  any  one  completion. 

Tiegs°  is  also  in  agreement  with  many  other  leading  edu- 
cators when  they  state  that  the  completion  statement  has  no 
place  in  an  objective  exam  because  frequently  they  have  to  be 
scored  subjectively.  Because  so  many  experienced  men  are  of 
one  accord,  it  was  decided  to  eliminate  completion  items 
entirely. 


1.  Harry  A.  Greene,  Albert  N.  Jorgensen,  J.  Raymond  Gerberich, 
Op . Clt . . p 170. 

2.  Jacob  S.  Orleans  and  Glenn  Sealey,  Objective  Tests,  World 
Eook  Company,  Yonkers-on-Hudson,  New  York,  p 231 . 


3.  Ernest  vi.  Tiegs,  Tests  and  Measurements  for  Teachers, 
Houghton  Mifflin  Company,  Boston,  1931,  p 247. 
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TABLE  FOUR 

ITEM  ANALYSIS  PART  III 


I TEM 

UPFER  QUARTER 

LOWER  QUARTER 

PER  CENT 

STAN- 

CRIT- 

OF 

OF 

DIFFER- 

DARD 

I CAL 

CORRECT  ANSWERS  CORRECT  ANSWERS 

ENCE 

ERROR 

RATIO 

111 

.70 

.16 

.54 

.083 

6.506 

112 

.84 

.30 

.54 

.083 

6.506 

113 

.42 

.38 

.04 

.103 

0.388 

114 

.56 

.14 

.42 

.086 

4.883 

115 

.66 

.14 

.52 

.083 

6.265 

116 

.82 

.48 

.34 

.089 

3.820 

117 

.66 

.26 

.40 

.091 

4.397 

118 

.86 

.14 

.72 

.069 

10.434 

119 

.40 

.38 

.02 

.098 

0.204 

120 

.28 

.04 

.24 

.064 

3.750 

121 

.82 

.24 

.58 

.081 

7.160 

122 

.92 

.80 

.12 

.069 

1.739 

123 

.86 

.64 

.22 

.084 

2.619 

124 

.82 

.46 

.36 

.089 

4.045 

125 

.84 

.42 

.42 

.088 

4.772 

126 

.56 

.26 

.30 

.094 

3.191 

127 

.60 

.34 

.26 

.096 

2.708 

128 

.32 

.04 

.28 

.072 

3.889 

129 

.28 

.06 

.22 

.072 

3.055 

130 

.52 

.34 

.18 

.098 

1.836 

131 

.30 

.42 

.38 

.090 

4.222 

132 

.68 

.20 

.48 

.087 

5.517 

133 

.88 

.30 

.58 

.080 

7.250 

134 

.46 

.18 

.28 

.089 

3.146 

135 

.52 

.30 

.22 

.096 

2.291 

Five  items  in  part 

three  have 

no 

particular 

value  for 

testing  according  to  Table  Four. 

Item  113  has  a 

critical  ratio 

of  0. 

388;  item  119  has 

0.204;  122, 

1. 

739;  130,  1. 

836;  all  other 

items 

in  part  three  are 

well  above 

2. 

576  and  will 

. be  retained 

as  good  testing  items. 


TABLE  FIVE 


ITEM  ANALYSIS  PART  IV 


ITEM  UPPER  QUARTER 
OF 

CORRECT  ANSWERS 


LOWER  QUARTER 
OF' 

CORRECT  ANSWER* 


PER  CENT  STAN-  CRIT- 
DIFFER-  DARD  I CAL 
MCE  ERROR  RATIO 


136 

.36 

.08 

.28 

.078 

3.589 

137 

.96 

.70 

.26 

.071 

3.662 

138 

.58 

.16 

.42 

.087 

4.827 

139 

.32 

.04 

.28 

.072 

3.889 

140 

.92 

.80 

.12 

.069 

1.739 

141 

.86 

.42 

.44 

.086 

5.116 

142 

.60 

.34 

.26 

.096 

2.708 

143 

.82 

.48 

.34 

.089 

3.820 

144 

.86 

.54 

.32 

.086 

3.721 

145 

.52 

.24 

.28 

.093 

3.011 

146 

.84 

.26 

.58 

.081 

7.160 

147 

.96 

.52 

.44 

.076 

5.789 

148 

. 66 

.26 

.40 

.091 

4.397 

149 

.54 

.34 

.20 

.097 

2.062 

150 

.58 

.16 

.42 

.087 

4.827 

Two  items  according  to  the  figures  in  Table  Five  should 
either  be  eliminated  or  revised  in  the  fifteen  items  making 
up  Part  IV.  These  are  items  140  with  a critical  ratio  of 
1.739,  and  item  149  whose  critical  ratio  is  2.062. 
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TABLE  SIX 


SCORES  AND  INTELLIGENCE  QUOTIENTS 
OF  LOWER  QUARTER 


SCORE 

I.Q. 

•M. 

* 

SCORE 

I.Q. 

99 

114 

87 

98 

116 

87 

110 

98 

113 

•a' 

86 

98 

* 

86 

98 

100 

“a* 

84 

98 

116 

/V 

84 

103 

98 

103 

84 

98 

98 

84 

98 

110 

* 

83 

97 

97 

-><. 

82 

97 

110 

80 

97 

108 

78 

97 

120 

78 

101 

97 

125 

* 

77 

97 

97 

113 

„v 

75 

108 

97 

/V 

75 

120 

95 

106 

a' 

75 

117 

95 

115 

74 

101 

95 

104 

74 

79 

94 

108 

j/. 

73 

78 

94 

72 

115 

93 

JL 

72 

98 

93 

96 

* 

72 

85 

93 

107 

>V 

71 

104 

93 

104 

70 

99 

Not  all  the  I.Q.  ratings  were  available,  but  of  these 
thirty-six  listed  in  Table  Six,  nine  or  twenty-five  percent 
were  under  100. 

According  to  the  classification  by  Term an  and  Merrill^ 
thos e having  an  IQ  of  140  or  over  may  be  classed  as  genius  or 
very  close  to  genius.  People  with  an  IQ  of  between  130  and 
139  are  very  superior;  120-129,  superior;  110-119,  above 
average;  90-109,  average;  80-89,  below  normal;  70-79,  border- 
line cases  or  dull;  60-69,  feeble-minded;  and  below  59  are 
classified  as  idiots  or  imbeciles. 


1.  Lewis  M.  Terman  and  fraud  A.  Merrill,  Measuring  Intelligence, 
Houghton  Mifflin  Company,  Boston,  193^,  ps.  38-41. 
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TABLE  SEVEN 


scorb;s  AND  INTELLIGENCE  QUOTIENTS 
OF  UPPER  QUARTER 


SCORE 

I.Q. 

W 

SCORE 

I.Q. 

144 

133 

* 

127 

116 

142 

131 

A 

127 

103 

142 

120 

ft 

127 

119 

141 

140 

*}<r 

126 

110 

141 

ft 

126 

129 

141 

120 

125 

115 

157 

110 

ft 

125 

103 

136 

115 

125 

136 

107 

124 

117 

135 

132 

A 

124 

120 

135 

ft 

124 

128 

135 

103 

A 

124 

116 

135 

115 

123 

132 

W 

A 

123 

116 

131 

121 

-X- 

123 

98 

130 

107 

'X- 

123 

102 

130 

105 

a’ 

123 

110 

130 

118 

123 

108 

129 

118 

123 

123 

129 

125 

A 

123 

97 

129 

112 

w 

121 

106 

128 

108 

121 

95 

128 

115 

121 

111 

128 

*x- 

121 

115 

127 

-)!* 

121 

106 

A* 


Of  the  upper  fifty  students,  forty-three  IQs  were  avail- 
able. In  general.  Table  Seven  indicates  that  the  higher  marks 
are  connected  with  the  higher  IQs.  Stoddard1  believes  that 
the  IQ  is  not  always  constant,  supporting  Alfred  Binet’s  con- 

p 

tention  that  given  certain  conditions  of  environment,  the  IQ 
will  improve. 


1.  George  D.  Stoddard,  "The  IQ;  Its  Ups  and  Downs,”  Educational 
Record,  Vol.  20,  Supplement  No.  12,  January  1939,  ps.  44-57. 

2.  Alfred  Binet,  Les  Idees  .Modernes  sur  les  Enfants,  Flammarion 
Paris,  1909,  ps.  145-147. 
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TABLE  EIGHT 

DISTRIBUTION  OF  IQs  AMONG  THE 
UPPER  AND  LOWER  QUARTER1 


IQ 


DISTRIBUTION 

UPPER  QUARTER  LOWER  QUARTER 


140  and  above 

1 

0 

130-139 

3 

0 

120-129 

8 

3 

110-119 

17 

11 

90-109 

14 

19 

80-89 

0 

1 

70-79 

0 

2 

60-69 

0 

0 

Below 

0 

0 

43 

V 

36 

Table  eight  reveals  that  the  largest  number  of  IQs  in  the 
Upper  Quarter  are  centered  in  the  110-119  group  or  the  above 
average  group.  No  one  in  the  upper  quarter  ranked  below  the 
normal  group. 

1.  Based  on  figures  of  'Tables  6 and  7. 
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The  lower  quarter  indicates  a lower  IQ,  with  nineteen 
cases  in  the  90-109  or  average  group.  Eleven  out  of  the 
thirty-six,  or  nearly  twenty-five  percent  in  this  lower  quarter 
show  IQs  in  the  above  average  or  from  110-119  group. 

The  IQ  is  still  far  from  being  a perfect  measure  of 
brightness.-1-  The  teacher  should  realize  that  often  times  many 
other  criteria  enter  into  the  results  of  taking  a test  such  as 
emotion,  health,  motivation,  etc. 

fhere  is  really  no  basis  of  comparison  between  the  scores 
of  the  test  and  the  IQ  ratings  because  all  pupils  were  at  the 
ninth  grade  level  when  they  took  this  test.  A comparison  by 
age  groups  was  not  attempted. 


1.  Harry  A.  Green,  Albert  N.  Jorgensen,  J.  Raymond  Gerberich, 
Op.  Cit . , p 229 . 


. 


* 


42 


TABLE  NINE 

FREQUENCY  DISTRIBUTION 
OF  TEST  SCORES 


CLASS  INTERVAL 
(C.I. ) 

FREQUENCY  OF  DISTRIBUTION 

143-147 

1 

133-142 

5 

133-137 

7 

128-132 

13 

123-127 

22 

118-122 

18 

113-117 

35 

108-112 

8 

103-107 

22 

98-102 

30 

93-97 

16 

88-92 

00 

83-87 

6 

78-82 

6 

73-77 

6 

68-72 

5 

200 

From  the  preceding  table  and  the  formula  fd  x c.i.  to 

n 

get  the  correction  which  is  added  to  the  assumed  mean,  the 
arithmetic  mean  arrived  at  was  109.575.  Using  the  same  figures 
in  Table  Nine,  it  was  discovered  that  the  median  was  108.060. 
The  mode,  or  the  score  made  by  the  largest  number  of  students 
was  in  the  class  interval  115-117,  which  area  was  obtained  by 
thirty-five  pupils. 

The  median"*"  is  important  because  it  provides  a measure 
of  central  tendency,  easily  computed.  The  median  also  fur- 
nishes a basis  of  comparison  of  results  of  two  or  more  groups 
taking  the  same  test.  . However,  the  mean  should  be  used  when 
exact  comparisons  are  made.  The  median  was  computed  on  the 
two  hundred  students  as  one  group,  because,  by  examination  of 
courses  of  instruction,  text  books,'  presentation  habits  of  the 
teachers,  it  was  felt  that  all  groups  had  had  similar  prepara- 
tion. MThe  median  is  frequently  taken  as  the  ’norm'  in 

p 

standardized  tests. " 

The  most  commonly  used  measures  of  variability  are  "the 

range,  10-90  percentile  range,  quartile  deviation,  and 

2 

standard  deviation.” 

T.  J . Murray  Lee,  A Guide  to  Measurement  in  Secondary  Schools, 
D.  Appleton-Century  Company,  New  York,  1936,  p 449. 

L.  A.R.  Gilliland,  R.  H.  Jordan,  Frank  S.  Freeman,  Educational 
Measurements  and  the  Class  Room  Teacher,  The  Century  Company 
New  York,  1931,  p 353. 


3.  J.. Murray  Lee,  Op . C 1 t . , p 445. 
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The  range  or  spread  was  from  144  down  to  70,  or  seventy- 
four  points.  The  range  is  too  easily  influenced  by  extreme 
scores  to  be  considered  a good  measure  of  variability. 

The  10-90  percentile  range  has  little  value  in  diagnosing 
results  of  testing  although  it  is  considered  a fine  measure  of 
variability.  ’’The  10-90  percentile  range  is  the  distance  be- 
tween the  10th  and  90th  percentile  points.”'*'  The  formula  is 
D=PgQ—  Piq  when  PGq  is  the  90th  and  P1Q  is  the  10th  percentile 
point.  Because  it  has  little  value  as  far  as  results  of  the 
test  are  concerned,  this  measure  of  variability  is  merely  men- 
tioned in  passing. 

The  standard  deviation,  based  upon  computation  of  figures 
in  Table  Nine,  was  found  to  be  16.15,  using  the  formula  for 


Slightly  over  one  third  of  the  cases  in  a normal 
distribution  lie  between  the  mean  and  a point  one 
standard  deviation  from  it  . . . 68.27  percent  . . . 
of  all  the  cases  in  a normal  distribution  differ  from 
the  mean  by  no  more  than  the  standard  deviation.  Al- 
though these  figures  do  not  hold  exactly  for  distri- 
butions that  are  NOT  normal,  they  are  ordinarily 
assumed  to  do  so  and  . . . are  commonly  employed  in 
connection  with  all  frequency  distributions.^ 


1.  Loc.  Clt. 

2.  G.  W.  Odell,  Educational  Measurement  in  the  High  School, 
The  Century  Company,  foew  York,  1930 , p 573. 
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Standard  deviation  is  also  important  in  assigning  grades. 

"Quart ile  Deviation  (Q  * Q^  - Q]_)  is  usually  employed  when 

2 

the  median  is  used  as  the  measure  of  central  tendency,  standard 
deviation  is  usually  used  when  the  measure  of  central  tendency 
chosen  is  the  mean."-'- 

Using  this  formula  in  connection  with  Table  Nine,  it  was 
found  that  the  quartile  deviation  was  4.38. 

Instead  of  a normal  curve,  a positive  skew  curve  would 
be  apparent  from  the  200  students  to  whom  the  test  was  ad- 
ministered because  of  the  relatively  high  selectivity  in  a 
college  preparatory  group. 


1.  Ernest  Tiegs,  Op 


Cit . . p 227. 
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CHAPTER  .V 


SUMMARY  . 

1.  Item  analysis  shows  that  of  the  one  hundred  fifty 
items  in  the  test,  the  following  items  had  a critical  ratio 
below  2.576: 

*.  Part  1,  ten  items 

Part  2,  seventeen 
Part  5,  five 
Part  4, v two 

or  a total  of  thirty-four  items  which  may  be  considered  as 
non-significant.  Part  two,  as  indicated  by  the  item  analysis, 
seems  to  have  been  the  most  difficult.^  More  items  in  this 
part  were  unanswered  than  in  any  other  part  of  the  test.  This 
would  seem  to  indicate  one  of  two  things:  either  the  questions 

were  unwieldly  in  their  set-up,  making  it  difficult  for  ninth 
graders  to  understand,  or  that  instruction  was  weak  in  certain 
parts  of  Roman  history.  It  would  not  be  probable,  however, 
that  several  teachers  would  be  weak  in  instruction  of  the 
same  areas.  Too,  all  four  parts  of  the  test  included  Items 
selected  at  random  from  the  entire  period  covered  in  Roman 
history.  ^ 

TT  See  Table  3,  p 31 
2.  See  Table  1,  p 3 
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2.  The  test  measures  objectively,  achievement  in  Roman 
history.  nA  general  achievement  test  is  one  designed  to  ex- 
press in  terms  of  a single  score,  a pupil’s  relative  achieve- 
ment in  a given  field  of  achievement.”^ 

3.  Comparison  of  IQs  and  raw  score  results  indicate,  in 
general  that  the  students  with  the  higher  accomplishment  were 
those  with  the  higher  IQs. 

4.  A normal  curve  could  not  be  expected  because  of  the 
small  sampling.  With  a college  group,  it  would  seem  logical 
that  a positive  skew  would  be  the  result.  Had  the  test  been 
administered  to  a larger  group,  perhaps  of  eight  hundred  to 
one  thousand,  an  attempt  would  have  been  made  to  plot  the 
resulting  curve. 

The  situations  that  most  commonly  yield  results 
forming  a skew  curve  are  those  in  which  biased  or  non- 
random  selection  has  taken  place.  For  example,  if  instead 
of  testing  a random  group  of  eight-year  old  children,  one 
tests  only  those  in  the  fourth  grade  who  are  usually 
rather  highly  selected  as  to  ability,  the  resulting  dis- 
tribution of  scores  . . . will  probably  be  skewed  upward 
or  positively  . . . 

Students  in  a college  preparatory  section  who  are  subjected 
to  Roman  history  are  for  the  most  part,  a highly  selected 
group,  with  occasional  poorer  students  who  change  courses  at 
the  half-year  period  or  at  the  end  of  the  first  year  in  high 
school . 


1.  Herbert  E.  Hawkes,  E.  F.  Lindquist,  C.  R.  Mann,  editors. 
The  Construction  and  Use  of  Achievement  Examinatl o ns , 
Houghton  Mifflin  Company Boston,  1936,  p 23. 

2.  Odell,  op.  clt.  ps.  604-5. 
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5.  As  the  test  is  not  standardized, 
standard  deviation,  range,  quartile  range 
with  any  previous  criteria. 


the  mean,  median, 

, cannot  he  compared 
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SUGGESTIONS  FOR  FURTHER  RESEARCH 

1.  Further  sampling  could  be  done,  possibly  in  schools 
of  larger  cities  than  those  of  the  5, 000--10, 000  range  popula- 
tion such  as  was  taken  for  this  testing. 

2.  Test  could  be  standardized. 

3.  A more  thorough  check  could  be  made  concerning  com- 
parison of  the  IQ,  ratings  and  raw  scores. 

4.  Comparison  could  be  made  by  age  group  accomplishment 
and  raw  scores,  although  this  would  not  be  as  practical  when 
Roman  history  is  taught  only  at  the  ninth  grade  level. 

5.  Achievement  of  boys  could  be  compared  with  girls. 

6.  Test  could  be  revised  and  set  up  oy  chronological 
periods  instead  of  including  some  questions  from  the  entire 
period  of  Roman  history  such  as  was  done  in  this  test. 

7.  A section  devoted  to  map  skills  could  be  attempted. 

8.  Items  of  critical  ratio  under  2.576  could  be  revised 
to  make  them  more  discriminating  between  the  good  and  poor 
student  s . 
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9.  A survey  could  be  made  to  find  out  the  percentage  of 
school  systems  which  are  substituting  courses  in  World  history 
for  Ancient  history  to  see  whether  it  would  be  worth  while  to 
continue  testing  in  the  field  of  Roman  history. 

10.  Because  Roman  history  is  taught  only  at  the  ninth 
grade  level,  which  makes  it  impossible  to  get  age  and  grade 
norms,1  percentile  norms  might  be  worked  out  after  adminis- 
tering the  test  to  a thousand  or  more  students. 


1.  Edward  A.  Lincoln  and  Linwood  L.  Workman,  Testing  and  the 
Use  of  Test  Results,  The  Macmillan  Company,  New  York, 
TS357  p iW~. 
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APPENDIX 


COVER  SHEET  FOR  A TEST  IN  ROMAN  HISTORY 


LAST  NAME 


FIRST  NAME 


IQ 

(to  be  filled 
in  by  the 
teacher ) 


DATE 

BIRTHDAY 

(year)  (month)  (day) 


GRADE  IN  SCHOOL 

NAIVE!  OF  SCHOOL CITY  OR  TOWN 


POSSIBLE  SCORE  ACTUAL  SCORE 

60 PART  1 

50 PART  2 

25 PART  3 

15 PART  4 


150 


TOTAL 


APPENDIX 


DIRECTIONS  FOR  TEST  ADMINISTRATION 


1.  Make  sure  that  each  student  has  an  exam  consisting  of 
seven  sheets,  numbered  consecutively,  in  addition  to  an 
answer  sheet. 

2.  Before  the  test  begins  read  over  the  general  instructions 
carefully  with  the  students  to  make  sure  that  everyone 
taking  the  exam  knows  how  to  follow  the  instructions. 

5.  Stress  the  fact  that  ALL  answers  are  to  be  recorded  on  the 
answer  sheet.  Some  students  may  not  be  familiar  with  this 
procedure . 

4.  Stress  the  fact  that  NO  questions  will  be  answered  after 
the  test  has  started.  All  exams  have  been  carefully 
checked  as  to  readability  and  correctness  of  items. 

5.  Advise  the  student  not  to  hurry.  Each  student  should  have 
ample  time  in  which  to  take  the  test  leisurel?/,  as  well  as 
to  check  his  answers  within  the  ninety  minutes  alloted. 

6.  Call  the  attention  of  the  students  to  the  number  written 
in  red  pencil  in  the  upper  right  hand  corner  of  their 
answer  sheet.  Their  scores  should  be  posted  according  to 
these  numbers. 

7.  Make  sure  that  each  student  had  written  his  or  her  name  on 
the  answer  sheet  in  the  space  provided,  along  with  his 
present  age,  date,  name  of  school,  and  town  or  city. 

8.  Allow  no  one  to  leave  the  room  until  the  ninety  minutes 
are  up.  Make  this  clear  before  the  exam  starts. 
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APPENDIX 

DIRECTIONS  FOR  SCORING 


1.  Each  examiner  will  score  the  papers  for  his  or  her  group 
according  to  the  key  accompanying  each  set  of  tests. 

2.  One  hundred  and  fifty  is  the  highest  possible  score. 

5.  All  UNANSWERED  items  are  to  be  counted  wrong. 

4.  There  is  but  ONE  correct  answer  for  each  of  the  one 
hundred  fifty  items.  Allow  no  deviations. 

5.  If  you  are  unable  to  read  the  writing  or  if  you  are  in 
any  doubt  as  to  what  the  student  has  written  for  his 
answer,  due  to  erasures  or  marked  out  items,  mark  the 
item  wrong. 

6.  Record  the  number  of  items  answered  correctly  in  the  space 
provided  for  each  of  the  four  parts  on  the  cover  sheet. 

7.  The  teacher  will  please  record  available  IQ  ratings  in 
the  space  provided  on  the  cover  sheet. 

8.  Return  both  cover  sheet  and  answer  sheet. 

9.  The  teacher  may  keep  the  exam  copies. 

10.  In  part  two  where  three  answers  are  required  for  each 

item  number,  all  three  must  be  correct  in  order  to  receive 
any  credit  for  that  item.  In  part  two  a which  requires 
two  answers,  both  answers  must  be  correct  to  receive  any 
credit  for  that  particular  item. 
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Thesis 
Locke,  SA 
1918 

Locke,  Sara  Agnes 

Construction  and  evaluation 
of  an  achievement  test... 


ISSUED  TO 


Thesis 
Locke,  S.A. 
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